Deep reinforcement learning for predictive aircraft maintenance using probabilistic Remaining-Useful-Life prognostics

The increasing availability of sensor monitoring data has stimulated the development of Remaining-Useful-Life (RUL) prognostics and maintenance planning models. However, existing studies focus either on RUL prognostics only, or propose maintenance planning based on simple assumptions about degradation trends. We propose a framework to integrate data-driven probabilistic RUL prognostics into predictive maintenance planning. We estimate the distribution of RUL using Convolutional Neural Networks with Monte Carlo dropout. These prognostics are updated over time, as more measurements become available. We further pose the maintenance planning problem as a Deep Reinforcement Learning (DRL) problem where maintenance actions are triggered based on the estimates of the RUL distribution. We illustrate our framework for the maintenance of aircraft turbofan engines. Using our DRL approach, the total maintenance cost is reduced by 29.3% compared to the case when engines are replaced at the mean-estimated-RUL. In addition, 95.6% of unscheduled maintenance is prevented, and the wasted life of the engines is limited to only 12.81 cycles. Overall, we propose a roadmap for predictive maintenance from sensor measurements to data-driven probabilistic RUL prognostics, to maintenance planning

Energy-delay trade-off of wireless data collection in the plane

We analyze the Pareto front of the delay of collecting data from wireless devices located in the plane according to a Poisson process and the energy needed by the devices to transmit their observations. Fundamental bounds on the energy-delay trade-off over the space of all achievable scheduling strategies are provided

Optimizing the battery charging and swapping infrastructure for electric short-haul aircraft—The case of electric flight in Norway

Recent advances in battery technology have opened the possibility for short-haul electric flight. This is particularly attractive for commuter airlines that operate in remote regions such as archipelagos or Nordic fjords where the geography impedes other means of transportation. In this paper we address the question of how to optimize the charging infrastructure (charging power, spare batteries) for an airline when considering a battery swapping system. Our analysis considers the expenditures needed for (i) the significant charging power requirements, (ii) spare aircraft batteries, (iii) the used electricity, and (iv) delay costs, should the infrastructure not be sufficient to accommodate the flight schedule. The main result of this paper is the formulation of this problem as a two-phase recourse model. This is required to account for the variation of the flight schedule throughout a year of operations. With this, both the strategic (infrastructure sizing) and tactical (battery recharge scheduling) planning are addressed The model is applied for Widerøe Airlines, with a network of 7 hub airports and 36 regional airports in Norway. The results show that a total investment of 4412 kW in electricity power supply and 25 spare batteries is needed for the considered network, resulting in a daily investment of €11700. We also quantify the benefits of considering an entire year of operations for our analysis, instead of just one congested day (7% cost reduction) or one average day of operations (31% reduction) at the most congested airport

Deployment vs. data retrieval costs for caches in the plane

We consider the problem of finding the Pareto front of the expected deployment cost of wireless caches in the plane and the expected retrieval cost of a client requesting data from the caches. The data is allocated at the caches according to partitioning and coding strategies. We show that under coding, it is optimal to deploy many caches with low storage capacity. For partitioning, we derive a simple relation between the cost of the cache deployment and the cost of retrieving the data from the caches. Lastly, we show that coding results in a lower Pareto front than partitioning

An optimal query assignment for wireless sensor networks

With the increased use of large-scale real-time embedded sensor networks, new control mechanisms are needed to avoid congestion and meet required Quality of Service (QoS) levels. In this paper, we propose a Markov Decision Problem (MDP) to prescribe an optimal query assignment strategy that achieves a trade-off between two QoS requirements: query response time and data validity. Query response time is the time that queries spend in the sensor network until they are solved. Data validity (freshness) indicates the time elapsed between data acquisition and query response and whether that time period exceeds a predefined tolerance. We assess the performance of the proposed model by means of a discrete event simulation. Compared with three other heuristics, derived from practical assignment strategies, the proposed policy performs better in terms of average assignment costs. Also in the case of real query traffic simulations, results show that the proposed policy achieves cost gains compared with the other heuristics considered. The results provide useful insight into deriving simple assignment strategies that can be easily used in practice

An investigation of operational management solutions and challenges for electric taxiing of aircraft

Taxiing aircraft using electric towing vehicles (ETVs) is expected to significantly contribute to the objective of climate-neutral aviation by 2050. This study reviews existing work on operational aspects of electric towing of aircraft, and discusses management solutions. We first discuss the varying electric taxi systems currently under development, and their implementation progress at airports. We outline the current specifications of ETVs and the procedures needed to perform electric taxiing movements. We next discuss the management needs for implementing ETVs at an airport, by reviewing existing mathematical models for ETV fleet management: dedicated vehicle routing models, ETV to flight assignment models, fleet sizing models and battery charging optimisation models. Last, we identify remaining research challenges. For instance, a main challenge is to increase the robustness of ETV routing and towing scheduling against disruptions due to flight delay. This paper summarizes the main research directions needed to support large-scale ETV implementation in the next few decades

Data retrieval time for energy harvesting wireless sensors

We consider the problem of retrieving a reliable estimate of an attribute monitored by a wireless sensor network, where the sensors harvest energy from the environment independently, at random. Each sensor stores the harvested energy in batteries of limited capacity. Moreover, provided they have sufficient energy, the sensors broadcast their measurements in a decentralized fashion. Clients arrive at the sensor network according to a Poisson process and are interested in retrieving a fixed number of sensor measurements, based on which a reliable estimate is computed. We show that the time until an arbitrary sensor broadcasts has a phase-type distribution. Based on this result and the theory of order statistics of phase-type distributions, we determine the probability distribution of the time needed for a client to retrieve a reliable estimate of an attribute monitored by the sensor network. We also provide closed-form expression for the retrieval time of a reliable estimate when the capacity of the sensor battery or the rate at which energy is harvested is asymptotically large. In addition, we analyze numerically the retrieval time of a reliable estimate for various sizes of the sensor network, maximum capacity of the sensor batteries and rate at which energy is harvested. These results show that the energy harvesting rate and the broadcasting rate are the main parameters that influence the retrieval time of a reliable estimate, while deploying sensors with large batteries does not significantly reduce the retrieval time

Dispatching a fleet of electric towing vehicles for aircraft taxiing with conflict avoidance and efficient battery charging

Following the Paris Accords, the aviation industry aims to become climate neutral by 2050. In this line, electric vehicles that tow aircraft during taxiing are a promising emerging technology to reduce emissions at airports. This paper proposes an end-to-end optimization framework for electric towing vehicles (ETVs) dispatchment at large airports. We integrate the routing of the ETVs in the taxiway system where minimum separation distances are ensured at all times, with the assignment of these ETVs to aircraft towing tasks and scheduling ETV battery recharging. For ETV recharging, we consider a preemptive charging policy where the charging times depend on the residual state-of-charge of the battery. We illustrate our model for one day of operations at a large European airport. The results show that the 913 arriving and departing flights can be towed with 38 ETVs, with battery charging distributed throughout the day. The fleet size is shown to increase approximately linear with the number of flights in the schedule. We also propose a greedy dispatchment of the ETVs, which is shown to achieve an optimality gap of 6% with respect to the number of required vehicles and with 22% with respect to the maximum delay during towing. We also show that both algorithms can be leveraged to account for flight delays using a rolling horizon approach, and that over 95% of the flights can be reallocated if delays occur. Overall, we propose a roadmap for ETV management at large airports, considering realistic ETV specifications (battery capabilities, kinematic properties) and requirements for aircraft collision avoidance during towing

A resilience assessment framework for complex engineered systems using graphical evaluation and review technique (GERT)

System resilience characterizes the capability of maintaining the required functionality under disruptions, which is of great significance in evaluating the productivity and safety of complex engineered systems. Although most studies conduct resilience assessment from qualitative and quantitative perspectives, system functionality that reflects functional requirements for complex engineered systems needs to be elaborated. In addition, given that complex engineered systems achieve dynamic performance during disruptions, measuring the actual performance under uncertainty is imperative. To this end, this paper develops a quantitative framework to assess the resilience of complex engineered systems. The developed framework comprises three phases, functionality analysis, performance evaluation, and resilience assessment. Firstly, system functionality is analyzed using a functional tree illustrating the relationship between functions. The overall objective, primary functions, and sub-functions are identified according to task requirements. Secondly, system performance is quantified considering uncertain factors through Graphical Evaluation and Review Technique (GERT). Probabilistic branches and network logic are employed to represent the implementation of various functions. Finally, resilience assessment is carried out from the perspectives of anticipation, absorption, adaptation, and restoration abilities. A case study on the satellite network shows the effectiveness of the developed framework. The developed framework determines system functionality based on task requirements, evaluates system performance with limited information, and accurately assesses system resilience